Quality Evaluation of a Business Process Semantic Annotations Approach

Semantic annotation is an approach to achieve semantic interoperability of heterogeneous resources. An ontology-based semantic annotation framework has been proposed, that can enrich and reconcile semantic representations of process models. The approach has been implemented in a prototype annotation tool, Pro-SEAT, to facilitate the annotation process. Evaluation methods for ontology-based semantic annotation is a new research topic a. We view the annotation framework as a modeling approach, and have choosen to adapt SEQUAL for the evaluation of the approach. SEQUAL has previously been used for the evaluation of modelling languages and approaches, including the evaluation of ontologies, process models, and requirements models and modeling languages. Using the semiotic quality categories in SEQUAL, an evaluation has been made at both the meta-model level (GPO and the PSAM specifications) and model level (the PSAM model instances and the Pro-SEAT tool).